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Abstract 

In this paper, we consider a distributed detection problem for a censoring sensor network where each sensor’s 
communication rate is significantly reduced by transmitting only “informative” observations to the Fusion Center 
(FC), and censoring those deemed “uninformative”. While the independence of data from censoring sensors is often 
assumed in previous research, we explore spatial dependence among observations. Our focus is on designing the fusion 
rule under the Neyman-Pearson (NP) framework that takes into account the spatial dependence among observations. 

Two transmission scenarios are considered, one where uncensored observations are transmitted directly to the FC 
and second where they are first quantized and then transmitted to further improve transmission efficiency. Copula- 
based Generalized Likelihood Ratio Test (GLRT) for censored data is proposed with both continuous and discrete 
messages received at the FC corresponding to different transmission strategies. We address the computational issues 
of the copula-based GLRTs involving multidimensional integrals by presenting more efficient fusion rules, based 
on the key idea of injecting controlled noise at the FC before fusion. Although, the signal-to-noise ratio (SNR) is 
reduced by introducing controlled noise at the receiver, simulation results demonstrate that the resulting noise-aided 
fusion approach based on adding artificial noise performs very closely to the exact copula-based GLRTs. Copula-based 
GLRTs and their noise-aided counterparts by exploiting the spatial dependence greatly improve detection performance 
compared with the fusion rule under independence assumption. 

Keywords: Distributed detection, Censoring, Dependent observations. Copula theory, Widrow’s quantiza¬ 
tion theory 


I. Introduction 

Advances in computational capabilities of the constituent sensor nodes inspired a surge of interest in distributed 
detection, in which the sensors send their locally processed data instead of raw observations to the FC, and the FC 
makes the final decision according to a certain fusion rule HI, lH. A new transmission-efficient distributed detection 
framework is considered in |l3|-|l6i, based on a send/no-send idea. The sensors “censor” their observations according 
to a certain mechanism to satisfy the communication rate constraints. In this process, sensors send their observations 
to the FC only if they are deemed “informative”. Thus, only a subset of observations are received at the FC for 
decision making. It has been proved that with conditionally independent sensor data, transmission occurs if and only 
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if the local likelihood ratio falls outside of a single “no-send” interval, under both NP and Bayesian frameworks 

13 , a. 

Detection problems with censoring sensors have been investigated from various perspectives, e.g., utilizing 
sequential detection ||2l, assuming fading channels IS) or under eavesdropper attacks ||9l- In ifTOl . the authors 
investigated the optimal censoring and transmission strategies by considering an asymptotic criterion involving 
error exponents in a network where sensors have access to some side information. The idea of censoring has also 
been applied for data reduction for estimation purposes in im-iia. 

Prior research on censoring for distributed detection and estimation has been carried out under the assumption 
of conditionally independent observations. However, dependence often occurs in practice as the sensors observing 
the same phenomenon are likely to have spatially dependent observations. The design of the censoring scheme at 
local sensors and the fusion rule at FC becomes highly complex as a result of dependence among observations. The 
effect of dependence on the performance of distributed detection has been investigated recently in lfT4ll - lfT8l . The 
authors in im and ll^ considered physics-based models of spatial correlation and protocol-based communications 
and constraints, with alternative forms of censoring. The detection problem with censoring sensors considered in 
im, 1221, assumes that spatial dependence among observations is known to the FC. In many practical situations, 
such information is not available, due to either the intrinsic non-stationarity of the signal 113 or heterogeneity of 
the sensing modalities. 

In this work, we consider the fusion of censored data for distributed detection in a heterogeneous sensor network 
under unknown inter-sensor dependence. To tackle the issue of unknown spatial dependence which can be nonlinear 
and quite complex, we apply the statistical theory of copulas which has previously been used for hypothesis testing 
with analog and quantized data in ifTbl . 123. The main contributions of this paper are as follows: 

• A copula-based GLRT for analog censored data is proposed under the NP framework, which, by accommodating 
unspecified spatial dependence, generalizes our prior study on censoring in ll22l . For Wireless Sensor Networks 
(WSNs) with limited transmission resources including power and channel bandwidth, we also consider the 
scenario where the uncensored measurements are quantized to further reduce the amount of data transmitted 
from sensors to the FC 13, lEl. For the fusion of the discrete data with unknown dependence at the FC a 
copula-based GLRT is derived. The GLRTs for both analog censored data and quantized-censored data exploit 
the censoring mechanism and the inter-sensor dependence for improved detection performance. As will be 
evident later, the two GLRTs are computationally expensive, especially in a large sensor network. 

• To address the computational issue of the copula-based GLRT for analog censored data, an alternative fusion 
approach is proposed. In this approach, each unreceived message is substituted with the noise generated 
according to a uniform distribution at the FC. Such approximated fusion rule reduces the computational 
complexity of the “exact” copula-based GLRT with very small amount of performance loss. 

• Further, to address the computational issue of the copula-based GLRT for quantized-censored data, a noise- 
aided GLRT is proposed based on Widrow’s theorem of quantization HD, na, in which a controlled noise 
is added to these discrete-valued signals. The noise-aided approach greatly simplifies the fusion rule by 
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completely eliminating the necessity of computing multidimensional integrals while achieving comparable 
detection performance in certain ranges of censoring rate. 

The four fusion rules proposed in this paper are able to accommodate different sensor modalities (different marginal 
PDFs), different individual censoring constraints, and different channel capacities (number of bits that can be 
transmitted) and, therefore, are applicable to many practical detection problems in heterogeneous sensor networks. 

The rest of the paper is organized as follows. In Section |II] we present our model in detail and formulate the 
problem of censoring. In Section [Till copula theory is introduced and copula-based fusion rules are derived under 
two different transmission scenarios. In Section IIVI we propose an alternate fusion rule for analog censored data 
to address the computational issue. In Section [V] we propose a computationally efficient fusion rule for quantized- 
censored data based on Widrow’s quantization theorem. Simulation results are provided in Section |VT] Section [Vn] 
includes some concluding remarks and suggestions for future work. 


II. Problem formulation 


We consider the detection problem in a sensor network where the two hypotheses are denoted by Hq (null) and 
Hi (target). A total of N sensors are deployed to observe the phenomenon of interest and the Fusion Center (FC) 
also takes its own observations. We use the random variables Xn and Xq to respectively denote the observation 
of sensor n and the observation of the FC at each time instant. It is assumed that the real-valued observations of 
each sensor and the FC are independent and identically distributed (i.i.d) over time with known probability density 
function (PDF) fn{xn\HQ) and fn{xn\Hi), respectively under hypotheses Hq and Hi, i.e., for each sensor n during 
any time interval 1 < I < L 

L 

f{Xnl, . . • , XnL\Hi) = fn{Xnl\Hi) ( 1 ) 

where Xni denotes the observation at time instant I and L is the length of the decision window. However, spatial 
dependence exists among sensors’ and FC’s observations, i.e. for each time instant I, 

N 

f{xoh ■ ■ .,Xni\H,) ^ fn{Xnl\H^) (2) 

n—0 

and it is not specified. 

In a censoring sensor network, each sensor node decides to transmit or not based on a function of its own 
observation hn{xni), such as the likelihood ratio function. When hn{xni) falls in the sending region the 
message Uni is transmitted, otherwise nothing is sent. Thus, the censoring operation takes the following form: 


^n(^n/) C Rrii, ’^nl — '^n (,Xnl) is Sent 
hn{xni) S nothing is sent 


(3) 


where the complement set R'^ is the censoring/no-send region and 7n (•) denotes the mapping from observation to 
message. 
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In many detection problems, “null” (Hq), namely the “normal condition”, occurs much more frequently than 
“target” (Hi), and therefore, the probability of censoring is considered only under Hq in this paper. In the NP 
framework, the censoring region R'^ of each sensor satisfies an individual censoring rate constraint as follows 

P{h„{X„) G R^\Hq) = Pn ( 4 ) 


where 0 < Pn< 1 and 


P{K{X^) € R:^\Hq) = J fniXn\HQ)dXn ( 5 ) 

is the probability that sensor n censors its observations under Hq. Censoring results in the transmission of the most 
“informative” observations under the censoring rate constraint so as to attain the best possible detection performance. 

It has been proved in |I3 that given conditionally independent observations, the optimal and 7„(-) in the 

censoring scheme Q are both likelihood ratio functions, i.e.. 


^niXnl) 


fn{Xnl\Hi) 
fn {Xjil l-^o) 


(6) 


and R'^ is a single interval. That is only extremal or very “informative” likelihood ratios are transmitted. For the case 
of dependent observations, we assume that the censoring scheme in Q is applied with hn{-) being the likelihood 
ratio function and being a single-intervafl. The censoring scheme can be rewritten as 


Xnl G Rn^ ttnl — ^niXnl) is Sent 
Xni € Rn, nothing is sent 


( 7 ) 


where 


Rn = h^^iRj and i?„ = h„^{R'J 


( 8 ) 


If the ratio of the two PDFs is a non-decreasing function in the argument Xni, we say that they exhibit the Monotone 
Likelihood Ratio (MLR) property in Xni- For the distributions /„(-|iFi) and fn{'\Ho) satisfying the MLR proerty, 
i.e., hn{-) is non-decreasing, it can be proved that preserves the single interval nature of the censoring region 
according to its definition in ([8]l. In this paper, we assume that the observation at each sensor node satisfies the 
MLR property y. Thus, we have i?„ := [tniRn 2 \, where tni and f „2 are respectively the lower and upper limits of 
the no-send interval. 

We further define two sets; C; := {n : Xni G Rn} and S/ := {n : Xni G Rn} to respectively represent the set of 
sensors whose observations are censored and the set of sensors whose observations are transmitted at time instant 
1. We use Us, = {uni '■ n G S/} to denote the set of messages that are transmitted from the sensors to the FC at 


'Finding the optimal censoring region in the case of dependent sensor observations is quite difficult, even with the arguably simplest case of 
multivariate Gaussian observations (25). 

^Many families of distributions satisfy the MLR property, such as the one-parameter exponential family. 
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time instant 1. 

Assuming ideal sensor-to-FC channels, the FC makes the decision about the true state of nature by combining 
the messages ug = {u§j,..., u§^ } from the sensors with its own observations xq = {xqi, ..., xql}- We focus 
on designing the fusion rule 7 o(us,Xo) in the NP framework, assuming that each sensor’s censoring scheme is 
known to the FC. The optimal fusion rule in the NP sense maximizes the probability of detection Po subject to 
the constraint that Pp is no greater than a, i.e.. 


max Pd ( 70 ), 

70 

subject to Pf( 7 o) < ct (9) 


where Pp = P( 7 o(us,xo) = l|Pi) and Pp = P( 7 o(us,Xo) = l|Po)- 


The design of the fusion rule is considered under two transmission scenarios in which, depending on the mapping 
from uncensored observations to messages, either continuous or discrete data from sensors is transmitted. 

Scenario A-C: Analog censored data is transmitted. Uncensored raw observations are directly transmitted to the 
FC, i.e., jn{xni) = Xni for n € §;. In this case, x§, = {xni : n € Si} is received at time instant I, and the fusion 
of the analog censored messages xg = {xg^,..., xg^^} along with Xq is considered. 

Scenario Q-C: Quantized-censored data is transmitted. Uncensored observations are first quantized by a multilevel 
finite-range [^uniform quantizer and then transmitted. Data that fall in the two send-zones {— 00 , f„i) and (f„ 2 , + 00 ) 
are respectively quantized by a uniform quantizer with step size that is determined by the number of bits that can 
be transmitted over the channel. We consider finite-range quantization with negligible saturation error. Any input 
signal occurring within a given quantization partition is reported at the quantizer output as being at the center of that 
partition (i.e., the input is rounded-off to the center of the partition). The explicit quantizer output = ■yn(Xni) 
is given by: 

'Jn^Xnl') — 


ini “t" Qn!‘^: 

tnl + <ln L ^" J + ^nl‘2, 

tn2 + Qn J + 9n/2, 

in2 ~i~ UnQn 

\ 


^nl ^ (-^n l)^n) 

^nl ^ [^nl (-^n 

^nl ^ (^n2j^n2 “1“ (^n l)^n] 

Xni e {tn2 + {Un “ l)^n, +Oo) 


( 10 ) 


where and Un are respectively the number of quantization levels of the two send-zones and [x\ represents 
the largest integer that is no greater than x. Each quantization partition can be represented by an integer U € 
{—Lnj . -., — 1 , 0 , 1 ,..., C/n — 1 }, and corresponds to the value of kn{in) at the quantizer output 


^n(^n) — 


fnl '^nQn ^ 0 

in2 H" Qnl^-> ^ 0 


( 11 ) 


^In a finite-range quantizer, the input signals that exceed the dynamic range of the quantizer take on the value of the saturation level. The 
quantizers in this paper all refer to finite range quantizers, for simplicity of presentation we refer to them only as quantizers. 
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Thus, the i„-th quantization partition is the set of inputs corresponding to the output value i.e., Qi^ := 

{xni ■ ln{xni) = fcn(*n)}- In Other words, the reception of Uni = kn{in) indicates that the raw observation Xni is 
in partition Qi^. 

Fusion rules under these two transmission scenarios will be derived. The design of the fusion rule needs to take 
into consideration not only the unknown inter-sensor dependence, but also the mechanism of missing data which 
is the known censoring scheme to achieve better detection performance. 

III. COPULA-BASED FUSION 

In this section, we develop the fusion rules based on copula theory for analog censored observations and quantized- 
censored observations respectively. Before we proceed, we first briefly introduce the basic concepts of copula theory. 


A. Copula theory 

Copulas are parametric functions that couple univariate marginal distributions to a valid multivariate distribution. 
They explicitly model the dependence among random variables, which may have arbitrary marginal distributions. 
Copula theory is an outcome of the work on probabilistic metric spaces 12^ and a copula was initially defined, on 
the unit hypercube, as a joint probability distribution for uniform marginals. Their application to statistical inference 
is possible largely due to Sklar’s Theorem, which is stated below without proof ll27l . 

Theorem 1 (Sklar’s Theorem). Consider an N-dimensional distribution function F with marginal distribution 
functions Fi,, Fn- Then there exists a copula C, such that for all Xi,... ,xm in [—C)0, oo] 

F{xi,X2, .. ■,xn) = C{Fi{xi),F2{x2),.. .,Fn{xn)) (12) 


If Fn is continuous for 1 < n < N, then C is unique , otherwise it is determined uniquely on RanFi x ... x RanF^ 
where RanFn is the range of cumulative distribution function (CDF) Fn. Conversely, given a copula C and 
univariate CDFs Fi,..., Fn, F as defined in M2^ is a valid multivariate CDF with marginals Fi,..., Fn- 


As a direct consequence of Sklar’s Theorem, for continuous distributions, the joint PDF f{xi,..., xn) is obtained 
by differentiating both sides of (fTSli . 


N 


f{xi,. . .,Xn) = fnixn) c{Fi{xi), . . .,Fn{xn)) 


( 13 ) 


\n—l 


(14) 


where, /n(-) is the marginal PDF and c is termed as the copula density given by, 

d^C{vi,...,VN) 

where Vn = Fn{xn)- As indicated in EH, there are a finite number of well defined copula families that can 
characterize most dependence structures. Some of the popular copulas are given in Table |I] While not explicitly 
specified in (fT2l i and (fOl l. copula functions contain a dependence parameter that quantifies the amount of dependence 
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TABLE I 

Some copula functions 


Copulas 

Parametric Form 

Parameter Range 

Elliptical 


Gaussian 


$£(x) = /o"AA(x;0,S)dx, x G 

= inf {u. < rf A/*(x; 0, l)da:} 

S = [Pij],hj = 1,... ,m 
Pij G [~li 1] 

copulas 


Student-t 


., ('Um)), tiy,E • multivariate Student-t CDF 

u : degrees of freedom, 





• inverse CDF of univariate Student-f 

u>3 



Clayton 



<t> G [-l,oo)\{0} 

Archimedean 

Frank 


1| A 1 n^Ll [exp{-^rri}-l]\ 

4> € K\{0} 

copulas 


Gumbel 


exp{-(EIli(-ln«r)^)^| 

4> G [1, oo) 



Independent 



- 


between the n random variables. We denote the dependence parameter as </>, which, in general, may be a scalar, a 
vector or a matrix. 

An attractive feature of copulas is the invariance property which is given in the following theorem. 

Theorem 2 (Thm 2.4.3, itlTl l. Let X and Y be continuous random variables with copula CxY- If ct and jd are 
strictly increasing on RanX and RanY, respectively, then Ca(^x)i3{Y) = CxY- Thus, CxY is invariant under strictly 
increasing transformations of X and Y. 

This property will be employed when the raw sensor observation X is transformed by a piecewise linear 
compressor, later in Section IV-BI of this paper. 

An important step in modeling the joint distributions using the copula-based model in (fT4l i is how to choose c(-) 
from a finite set of copulas, say C = {cm '■ m = 1,..., M}. As will be shown later, copula model selection is 
embedded in the GLRT formulation, as well as the estimation of corresponding copula parameter cf). 


B. Fusion of analog censored data 

Under Scenario A-C, the joint PDF of received messages xg, and PC’s observation Xqi under hypothesis Hi,{i = 
0,1) is given as 


/(xs,,xoi|Ff*) = / ./x(xz,xo/|iF*)dxc, (15) 

n fln 

„ec, 

where x/ = {xu,... ,xni} , xc, = {xni '■ n € C;} and /x(-|Ffi) denotes the joint density function of all 
observations X := [Xi,... ,Xx,Xo] from the sensors and the FC under Hi. We use IlneCi represent the 

multifold integration regions f?Ci{i} ^Ci{|Ci|} where C/{j} is the j-th element of C/ and | • | denotes the 

cardinality of the set. The expression on the right hand side (RHS) of Equation (flSl l is the joint PDF of all the 
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observations integrated over the no-send regions of all censoring sensors, which yield the joint PDF of {xg, ,xo/} 
under Hi. The dimension of the integration is |C/|. 

The unknown joint distribution fx{xi,xoi\Hi) can be approximated using a copula density function. According 
to the copula-based formulation of a joint distribution in (fOl l. the density function in (flST l can be approximated by 

f (^S/ ; ^01 \ ^il 02? Hi^ 

fx{xi,xoi\Hi)dKc, 

N 

fn{Xnl\Hi)Ci{xi, X0l\(l)i)dxCt ( 16 ) 

n—0 

with 




Ci{xi,Xoi\4>i) = Ci{Fo{xoi\Hi),... ,FN{xNi\Hi)\4>i) 


( 17 ) 


where Ci denotes the copula density function applied to approximate the dependence structure under hypothesis Hi 
and (pi represents the corresponding dependence parameter. We have used the notation /(■) to emphasize that these 
are approximations. How Ci is selected from a library of copula density function C and how the parameter cpi is 
estimated according to the data that is available at the FC, will be discussed later in the section. 

The Generalized Likelihood Ratio Test (GLRT) at the FC can be obtained based on (fTbl l 


max n/(xs,,a:o;|ci,</>i,i7i) 

rr., X 

T(xs,Xo) = - - - ^ ry 

^ '' Hq 

max n ./(xs,,a:oi|co,</>o,-ffo) 
coeC,</)o 


( 18 ) 


where r/ is the threshold that satisfies the constraint Pf{v) = should be noted that copula selection and 

parameter estimation are embedded in the GLRT. The best copula c* is the one that has the highest likelihood 
score, i.e., 

L 

c* = a.Tgma.xT\ f{xsi,xoi\ci,(p^,Hi) ( 19 ) 

CiGC 

where, for any Ci € C, the corresponding parameter is estimated using maximum likelihood estimation 

L 

= arg maxTT /(xs;, xqi\ ci,(pi,Hi) (20) 

(h- 

" Z =1 

Since the true dependence model can be very complex and may not be present in the library of candidate copulas 
C, the best copula c* may still be misspecified. 

When independent observations are assumed across the sensors, the dependence structures under both hypotheses 
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are described by the product copula, i.e., c* = l,i = 0,1. In this case, the test statistic in t fTSi t reduces to 


r(xs,xo) = p[ 


1^1 


n n 


fn {Xjil l-^o) 


( 21 ) 


nGCi neSiU{0} 

where pn is the likelihood ratio between the two hypotheses when no message is received from sensor n, which is 
given as 


P(x„ei?„|Po) ^ 

The test statistic in (|2TI) is the same as the one derived under independence assumption in ||3, l|4l. 

Unlike the evaluation of the test statistic in (l2Tl i. which involves only one-dimensional integrals, the computation 
of r(xs, Xq) in (fTSl l for dependent observations involves multiple |Ci|-dimensional integrations due to the existence 
of spatial dependence. When the probability of censoring becomes higher for each sensor or the number of sensors 
in the network gets larger, |Ci| increases, so does the computational complexity of (fTSl l. 


C. Fusion of quantized-censored data 

In Scenario Q-C, where uncensored observations are quantized before transmission, discrete-valued messages 
are received at the FC. A copula-based rule for fusing these discrete-valued messages and continuous observations 
of the FC is developed in this subsection. 

Knowing local sensors’ censoring schemes, the joint likelihood that the dataset ug, = {kn{in) '■ n G Si} is 
received and xqi is observed at the FC under hypothesis Hi is 


f{{kn{in) ■ n G Si},Xoi\Hi) = 


/x(x/,xoz|iFi)<^x/ 


n fln 

neq 


n Qin 


(23) 


where dxi = dxu ... dxMi and recall that is the quantization partition corresponds to the output value 
Eq. (l23l l is the joint distribution of sensors’ and FC’s observations integrated over the no-send regions of the 
censoring sensors and the quantization partitions Qi^ of the transmitting sensors. The unknown joint distribution 
/x(xz, xoiliTi) can be approximated using a copula density function. Thus, the probability density function in (|2^ 
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can be approximated as follows 

/({fcn(*n) : n e E.i},xoi\Hi) 

N 

n fn{Xnl\Hi)Ci{xi,Xoi\4>^)dXi 
n—0 

(24) 

The dependence of the LHS of (l24l i on the copula model Ci and its parameter is not specified only for notational 
simplicity. Statistical theory of copulas is not applied directly to approximate the joint distribution of the discrete 
random variables {ui,... ,un} because copulas for discrete marginals are not well defined. Thus, we can only 
approximate the joint distribution of the continuous random vector X, through which the approximated probability 
of {ug,, Xqi} under each hypothesis can be obtained. It has to be noted that an TV-dimensional integration is involved 

in dal. 

Based on (l24l) . the joint distribution of u§, and xqi given Hi can be written as 

SGA/'i„ = -Ln 
raeSi 

(25) 


/ / 

n fln n Q 

neCj 


n fln n Q 

n^Ci 


where Ij.j denotes the indicator function. S represents a subset of N} and Af represents the set consisting 

of all possible S. 

The Generalized Likelihood Ratio Test (GLRT) at the FC can be written as 

L ^ 


r(us,xo) 


max n ./(usn^o |ci,^i,iFi) ^ 
ci6C.</.u=l 

-1-^ ^ 

max n/(uSi,Xo |co, 0o>^o) 

CqGC,(Pq I —I 


( 26 ) 


where p satisfies the constraint that Ppiv) = “• 

It is noted that evaluation of T(us,Xo) involves iV-dimensional integrations, thus the computational complexity 
increases drastically in the number of sensors. Therefore, we propose computationally efficient approximate fusion 
rules for both transmission scenarios in the following sections. 


IV. Noise-AIDED fusion of analog censored data 
An alternative fusion rule for analog censored dependent data is proposed in this section based on substituting 
unreceived messages with artificial noise. This approach eliminates the necessity of computing multidimensional 


March 30, 2015 


DRAFT 



11 


integrals and is, thus, more computationally efficient at the expense of slight performance loss. 

If the FC receives no signal from sensor n at /, then we only know that Xni S i?„, since neither the true 
underlying hypothesis nor the priors of the hypotheses are known. Thus, the uninformative prior in dZTl) is assumed 
for the distribution of the missing messages. 


f{Xnl) = 


^^2—ini’ Xnl € [fnl:fn2] 
0, otherwise 


(27) 


for all n G Cl- An artificial noise dni is generated according to the PDF in (l27l i to represent the unreceived message 
from sensor n at time instant 1. Let denote the message corresponding to sensor n after the addition of noise, 
if there is any, whose distribution under hypothesis Hi is given as 




(28) 


for all n = 1,..., iV. The new set of data consists of the received messages and the generated artificial noise terms, 
i.e., zi := {xs,,dci}, where dc, = : n e Q}. 

The joint PDF of the data set z; and xqi can be approximated using a copula density function 


fz.Xoi'^'l,Xoi\Ci, 

N 

= n fZr^iz:nl\Hi)fQ{XQl\Hi)Ci{Zl,Xol\(|)^) 
n—1 


= n 

neCi 


P{Xn G Ru\H,) 
tn2 


n fzAzni\Hi)fo{xoi\Hi) 

n&i 


XC,[zuXoi\(l)i) 


(29) 


where 


C? (z/, Xq/1 

c^[Fz^[zll\Hi),... ,Fzt,[zNi\Hi),FQ{xQi\Hi)\(t}i) 


Thus, the GLRT can be written as 


r(z,xo) = 




max n./z 

coGC,<Pq I—I 


Ho 


(30) 


( 31 ) 
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where z = {zi,..., z^}. By substituting < |29l t into the above test, we have a 


Ti2,Ko) = 




n n 

.tiGCi nGSi 


fz„{zni\Hi) fo{xoi\Hi) 

fz^izni\Ho) foixoi\Ho) 


max n Ci{zi,Xoi\(f)i) 

ciec,</>i i^i 

' L 

max n Co{zi,Xol\cl}o) 

CoGC,cf)Q 


(32) 


The first term of the test statistic in (l3^ which is exactly the same as the test statistic under the independence 
assumption in (ED, corresponds to the differences in the marginal statistics, while the spatial dependence and 
interactions are included in the second term. 

The test in ( |32] | does not require the computation of multidimensional integrals as the one in ( fTSl l, resulting in 
great computational efficiency. Since the SNR at the FC is decreased due to the addition of artificial noise, detection 
performance is degraded, but only by a relatively small amount as will be shown later in the simulations. 


V. Noise-aided fusion of quantized-censored data 

In this section, a computationally efficient fusion rule for quantized-censored data is proposed based on Widrow’s 
Theorem of quantization ||28l. We first briefly introduce Widrow’s Theorem of quantization. 


A. A Review of Widrow’s Statistical Theorem of Quantization 

According to Widrow 1291 . quantization of a random variable can be interpreted as the sampling of its PDF. 
Also, the PDF of the quantized random variable is the convolution of the original PDF with the PDF of a uniformly 
distributed random variable, followed by conventional sampling. The PDF of the uniform quantizer output can 
be expressed as: 


/u„ (a:) = {fw„ {x) * fx„ (x)) - tq^ - 

tel, 


(33) 


where + represents the convolution operation and S{x) is define as 

S{x) = 

and /w„ {x) is a uniform PDF as follows 


1, X = 0 
0, otherwise 


J_ -9^ < ™ 

fwjx)={ 2 - - 2 

0, otherwise 


(34) 


(35) 


Uniform quantization introduces two kinds of noise: (a) the additive noise Wn and (b) aliasing error due to sampling. 
However, if the Characteristic Function (CF) of the input PDF is band-limited such that 

TXn{v) = 0 for |t)| > then in principle the original PDF of the input can be reconstructed from the knowledge 
of fu„{x)- 
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Theorem 3 (Thm QTl, 1281 ). If the CF of Xn is “band-limited”, so that 



(36) 


then the PDF of Xn can be derived from the PDF of Un- 


Theorem 4 (Thm QT2, ED). If the CF of Xn is “band-limited”, so that 


pxni'u) =0, |w| >- e 


(37) 


with e positive and arbitrarily small, then the moments of Xn can be calculated from the moments ofUn- 


Noting that the conditions of Theorem |3 or Theorem |4] are more likely to be satisfied for small quantization step 


sizes qn, we consider the fusion rule that is suited for high-rate quantization. 

B. Computationally efficient fusion of quantized-censored data 

As discussed previously, the high complexity in computing the copula-based GLRT stems from the need for 


computing multidimensional integrals. We simplify the fusion process by adding controlled noise to the multilevel 


decisions received at the fusion center based on Widrow’s theory. 

Given the quantization step size which is determined by the number of bits that can be transmitted over the 
channel. We first propose a fusion rule that corresponds to a specific censoring region = [0,g„]. Then, the 
fusion rule is generalized to the case of any arbitrary censoring interval. 

For this specific censoring interval, receiving no signal from sensor n implies that the observation of sensor n is in 
the quantization partition [0, g„]. We can reformulate the problem as the one in which each sensor’s raw observations 
are quantized according to the following uniform quantizer and all local quantizer outputs {uni : n = 1,..., N} 
are transmitted to the FC for decision making. 



(38) 


According to Widrow’s Theorem ( l33l l, the CF of uniformly quantized data contains repeated and phase-shifted 


replicas due to the sampling process. We are able to keep the main lobe and filter out the terms due to aliasing in 
using a low pass filter (LPF). To do that, an externally generated noise dni with PDF /d„(-) is added to 
the discrete-valued observation before fusion. Let denote the generated noise and the new observation Zni is 


^nl — 'ttnl F dnl 


(39) 
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Correspondingly, the CF of the new observation is 

"■Pz^ = ‘Pu-n • PDr, (v) (40) 

The CF of noise should be band-limited to play the role of a LPF. A perfect LPF-noise would have a 
rectangular CF in — ^ <v< ^ which does not correspond to a valid PDF. Thus, attention needs to be paid while 
designing such that as little distortion as possible is introduced when transforming the discrete-valued {7„ to a 
continuous variable 

Most distributions that are employed in practice, like the Gaussian, exponential or chi-squared are not perfectly 
band-limited. This fact does not prevent the application of the quantization theorems if the quantum step size is 
significantly smaller than the standard deviation. If the condition stated in Theorem [3] is satisfied, we have the 
following relationship: 


Zn — Xn + Wn + Dn 


(41) 


Thus, at the FC, the PDF of data Zni under hypothesis Hi can be derived, which is 

/Z„ {Znl\Hi) = fn{Znl\Hi) * fw^ (Znl) * /d„ (Znl) (42) 


In practice, the quantizer output corresponding to the censoring interval which is g„/2, is generated 

at the FC to represent the missing messages before the addition of LPF-noise. So, dni is added to Uni for all 
n € Si and dni + Qn/ ‘ 2 . is generated for all n S C; to obtain the new observation Zni- The joint PDF of the data 
zi = {zii,..., Zni} and xqi, which are continuous, can be directly approximated by copula theory as follows 


fz.Xoi'Z'h Xoi\Ci, (f>i, Hi) = 

N 

f[ fz,,{zni\H^)fo{xoi\H^)c^{zi,xoi\cf)^) (43) 

n—1 

Thus, the GLRT can be written as 


T(z,xo) 




max n./z ,Xq (zi, Xqi |co, Hq) 

CQec,4>o i=i 


^ V 
Ho 


(44) 


where z = {zi,...,zl}. The proposed test in (l44l i is a function of continuous variables only and involve the 
computation of one-dimensional integrals. Compared with the test statistic in (l25l) which requires the computation 
of A^-dimensional integrals, the noise-aided fusion rule greatly simplifies the test. 

The noise-aided fusion rule is designed for the specific censoring interval of [0, qn] in the above discussion. Next, 
we generalize the test for the case of an arbitrary no-send region of [tni,tn 2 ]- It is worth mentioning that if the 
conditions for Theorem [3 or Theorem |4] are satisfied for Xn, these conditions are still satisfied even after adding 
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a constant b to X„. This can be explicitly explained from the expression for the CF of Xn + b: 

V>x„+b{,v) = ( 45 ) 

Similarly, an arbitrary shift of the quantization transfer characteristic in (fTOl i will not affect the fulfillment of the 
conditions of the theorems, either. Thus, without loss of generality, we assume = 0. 

The problem can be identified as the fusion of non-uniformly quantized dependent data in which all the quan¬ 
tization partitions are of length qn except for one which is [ 0 ,f„ 2 ]- It has been demonstrated that the statistical 
theory of quantization can also be applied to non-uniformly quantized data ll28ll . We can represent the quantizer 
by a piecewise linear compressor (we call it a compressor, but whether it is actually a compressor or an expander 
depends on the ratio tn 2 /qn), a uniform quantizer and a piecewise linear expander which is the inverse of the 
compressor. Since it is the probability that data comes from a certain quantization partition that is utilized in our 
test, we only need to consider the piecewise linear compressor and the uniform quantizer that follows it. 

A piecewise linear compressor is applied to the observations before quantization, whose output is given 
as 


Vnl — 9n{^nl') — 

^nl 5 ^nl ^ 0 

tnl < Xnl < tn2 (46) 

Xnl “b Qn^ ^ fn2 

Remark 1. Since (?«(•) is a strictly increasing function, according to the invariance property of copulas in Theorem 
12 the best copula that approximates the dependence among [Xi ,..., Xq], is also the one that describes the 
dependence structure among [Yi,..., Y^-, Xq], with the same dependence parameter. 

If we can ascertain the band-limitedness of the compressed signal Yn, quantization theory developed for uniform 
quantization can be applied to the uniform quantizer which follows the compressor. Due to the piecewise linear 
property of the transformation in (l46l l. the PDF of Yn contains jumps at the break points of p„(-). Because of such 
break points, the CF of Yn may not be perfectly band-limited. 

Figure [T] shows that the CF of raw data which is Gaussian distributed and the CF of the compressed signal 
Yn with different degrees of compression that is characterized by the ratio between the length of censoring interval 
and the quantization step size, i.e., tn 2 /qn- It can be seen that Y„ is not perfectly band-limited. However, when 
the quantization step size is set to qn = 1/2, (j){v) ~ 0 for |r;| > ir/qn = 27r, especially for small degrees of 
compression {tn 2 /qn < 3). The condition stated in Theorem |2 is satisfied very closely, when the length of the 
censoring interval is comparable to the quantization step size, or in other words, the break point of Pn(-) is not 
very “sharp”. 

The compressed data, pni, is passed through a uniform quantizer with quantization step size whose output 
is Uni = yniVni)- This approach successfully transforms the problem of designing computationally efficient fusion 
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Fig. 1. Characteristic functions of X and Y 


rule under arbitrary communication rate constraint to the fusion of uniformly quantized data, to which we already 
have a noise-aided solution from the previous discussion. 

Before fusion, a LPF-noise dni is added to each received data Uni to create continuous observation Zni = Uni + dni 
and each observation that is not received is replaced by Zni = qnj^ + drd- The new set of observations from sensors 
to be fused is z which are continuous. If the CF of Vn satisfies the condition of Theorem [3 closely and is 
properly designed as a LPF, we have the following relationship, 

Z„ = V^ + W„ + Dn (47) 

At the FC, the PDF of data Zni under hypothesis Hi can be written as 

fzA^nllHi) = fY„{Znl\Hi) * fWn.{Znl) * fo^iZnl) (48) 

The joint PDF of {z,Xo} can be approximated using a copula density function as in ( |29] | and the test statistic 
T(z,xo) is similar to the one in (l44li can be derived. The fusion rule based on the addition of controlled noise 
greatly reduces the computational complexity, but at the expense of decreased SNR at the FC. Thus, should be 
designed to introduce as little distortion as possible while filtering the required signal. 

In may practical situations, uniform quantization is not optimal, therefore, it is important to develop models 
that can accommodate non-uniformly quantized-censored data. It is always possible to represent the nonuniform 
quantizer by combining a piecewise linear compressor, as the one in (l46l) . a uniform quantizer, and a piecewise linear 
expander. If the CF of the compressed random variable satisfies the condition for Theorem [3 then the quantization 
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theory for uniformly quantized data can be applied. An example of a floating point quantizer is given in 12^ . 
and for the number of bits used in practice, the conditions required for the quantization theorem are satisfied very 
closely. 


VI. Simulation Results 

In this section, we provide simulation results to demonstrate the performance of our proposed fusion rules under 
different settings. We assume that under both hypotheses all sensors’ observations are Gaussian distributed as follows 

Vz = 0,l (49) 

for all n = 1,..., iV, where cr^) denotes the univariate Gaussian distribution with mean p and variance It 
is known that the CF of a Gaussian distribution is a bell shaped function which approximates a band-limited signal. 
The band-limitedness will be used in the noise-aided fusion under Scenario Q-C. We set [/ro,pi] = [0,0.5] and 
(7 = 3 and we assume that under Hq, sensors’ observations are independently distributed. The PC’s observation 
is distributed according to A/^(0.1,3^). Since the PC is remotely located, we assume that the PC’s observation is 
independent of all sensors’ observations under both hypotheses. Identical censoring rate constraints are applied for 
all sensors, i.e., I3i = ■ ■ ■ = Pn = P- Since we only focus on the fusion aspect of the detection problem for a given 
local censoring scheme, without loss of generality we assume the censoring region with the lower limit = 0 
and tn 2 is determined by the following censoring rate constraint 

^n2 

fn{Xn\Ho)dXn = P. 

We first consider a 2-sensor network, i.e., N = 2. Under Hi, the dependence between the two sensors’ 
observations is generated by a Frank Copula with the corresponding Kendall’s r being 0.3.0 

In Scenario A-C, sensor observations that are not in the censoring region [0,f„2] are transmitted to the PC. 
The received analog messages are directly used for deciding the true state of nature according to the copula-based 
GLRT in (fTSl) . but involving a high computational complexity. In the noise-aided GLRT, the unreceived messages 
are replaced by randomly generated noise at the PC before fusion. Then the detection is carried out according to 
(|3^ . In many papers, the inter-sensor dependence is ignored in the fusion of censored data for simplicity. Under 
independence assumption, the test is conducted according to (|2TI) . 

In Scenario Q-C, we set the quantization step size = (t/ 3 = 1. Sensor observations that are not in the 
censoring region [0, tn 2 ] are first quantized and then transmitted to the PC. After receiving the discrete messages, a 
copula-based GLRT is applied for deciding the true hypothesis according to (l26l) . In the noise-aided fusion approach 
that we proposed for this scenario, our setting of the quantization step size satisfies the conditions in Theorem 0] 
closely. The LPF-noise is designed to be Gaussian distributed with zero mean and variance an = 1- Distortion 
is introduced because the CF of Gaussian distribution does not yield an ideal LPF, but is tolerable for our settings. 

'^Kendall’s r is a non-parametric rank-based measure of dependence, ranging from —1 to 1. Nelsen has proved the following relationship for 
a copula, C, and random variables X ^ fYiv) 1271 p. 161]: t{<P) = 4E[C(i,{Fxix), FY(y))] — 1- 
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The PDF of the signal to be fused + Wn + which is nothing but the convolution of the three individual 

PDFs, is calculated numerically. Having the marginal PDFs, the noise-aided GLRT is conducted to test between 
the two hypotheses. 

We set the copula library, from which the best copula is selected, to be C= {Gaussian, Gumbel, Frank, Clayton}, 
which includes the true generating copula, Frank copula. The receiver operating characteristic (ROC) curves 
corresponding to different fusion rules for the given local censoring scheme are depicted in Fig. |2] It can be seen 
that in both Scenario A-C and Scenario Q-C, our proposed noise-aided GLRTs perform comparably with copula- 
based GLRTs in which multidimensional integrations are evaluated numerically. Both of our proposed approaches 
outperform the method under Independence Assumption (lA). The detectors perform better under Scenario A-C 
compared with those under Scenario Q-C, which is expected since in Scenario Q-C by reducing data transmission 
through quantization, performance loss is inevitable. 



Fig. 2. ROCs corresponding to different fusion rules in a 2-sensor network with /3 = 0.35. 

To study the impact of copula misspecification on detection performance, we remove the true copula Frank 
copula from the copula library. The library of copulas C, including Gaussian copula, Gumbel copula and Clayton 
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copula, does not contain the true copula. Such a setting allows us to examine the performance of copula-based 
fusion under the unfavorable situation of model misspecification. The performance of our proposed fusion rules with 
copula misspecification is shown in Fig. [3 The difference between the two curves corresponding to the detection 
performance with and without copula misspecification is demonstrated to be negligible in Fig. [3 Although the true 
dependence among sensor observations can be quite complex, a limited number of well defined copula families 
are able to characterize most dependence structures. Excluding the true copula from the copula library gives us an 
insight into the detection performance with misspecification in the most unfavorable situation. 
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Fig. 3. ROCs corresponding to different copula libraries with /3 = 0.3: Frank copula is used to generate the data, GLRT without misspecification 
corresponds to the case where C = {Gaussian, Gumbel, Clayton, Frank}, while GLRT with misspecification corresponds to the case where C = 
(Gaussian, Gumbel, Clayton}. 


The probability of correct detection Po for a given probability of false alarm Pp = 0.1 is plotted as a function of 
censoring rate /3 in Fig. [4] which captures the tradeoff between detection performance and communication efficiency 
in a censoring sensor network. It is observed that the performance degrades with increased censoring rate. Under 
Scenario Q-C, the gap between the performance of the noise-aided GLRT and the copula-based GLRT using brute 
force integration becomes larger with the increase in censoring rate. A higher censoring rate leads to a higher degree 
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of compression according to the piecewise-linear compressor defined in ( l46b in our noise-aided approach. 

Therefore, the conditions of Widrow’s quantization theory are more difficult to satisfy as shown in Fig. [T] and the 
main lobe of the CF of Un can not be recovered by the process of “hltering” without noticeable distortion. Thus, 
attention has to be paid while applying our fusion scheme based on LPF-noise when the censoring rate constraint 
is high. 



P 


Fig. 4. Pd as a function of censoring rate ^ under Scenario A-C and Scenario Q-C 


We also consider a multi-sensor network with iV = 3, where dependence among sensors is generated using a 
Gaussian copula with the parameter matrix given by 


R = 


I p p 
pip 
p p I 


where p = 0.25. In this example, the copula library C is assumed to include Gaussian copula and t copula. The 


ROCs corresponding to different fusion approaches in the multi-sensor network are given in Fig. [5] As can be seen, 
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the performance of our proposed fusion rules that take the inter-sensor dependence into consideration is better than 
the test derived under independence assumption (lA). And the noise-aided GLRTs perform comparably with the 
copula-based GLRTs under both transmission scenarios. With the increase in the number of sensors, computational 
saving of the noise-aided GLRT which transforms one A^-dimensional integral to N one-dimensional integrals 
becomes more significant. 
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Fig. 5. ROCs corresponding to different fusion rules in a multi-sensor network with /3 = 0.25 


VII. Conclusion 

A binary hypothesis testing problem was considered in a censoring sensor network with spatially dependent 
observations. Each sensor decides to transmit or to censor based on whether its current observation is “informative” 
or not. Two transmission scenarios were considered. In the first one, uncensored observations are transmitted directly 
to the FC; in the other, uncensored observations are uniformly quantized and then transmitted. Upon the reception 
of messages from all transmitting sensors, the FC fuses these messages with its own observations to make the final 
decision. The fusion rules for both analog censored data and quantized-censored data were proposed based on the 


March 30, 2015 


DRAFT 















22 


characterization of unknown spatial dependence using a copula density function. The copula-based GLRT for analog 
censored data involves multidimensional integration, thus is expensive to compute. To address the computational 
issue, an alternative fusion rule that involves replacing each censored observation with an artificial noise at the 
FC was proposed. Another computationally efficient fusion rule by injecting controlled noise to the discrete-valued 
messages was presented to address a similar computational issue with copula-based GLRT for quantized-censored 
data. Simulation results showed that copula-based GLRTs developed here for analog censored data and quantized- 
censored data and their computationally efficient versions yield significantly superior performance than the ones 
derived under the independence assumption. The design of local sensors’ censoring strategies and optimal artificial 
noise to be added at the FC for improved system performance is to be considered in our future work. 

ACKNOWLEDGMENT 

This material is based upon work supported by, or in part by, the U. S. Army Research Office under grant number 
W911-NF-13-2-0040. 

References 

[1] J. N. Tsitsiklis, “Decentralized detection,” in In Advances in Statistical Signal Processing. JAI Press, 1993, pp. 297-344. 

[2] P. Varshney, Distributed Detection and Data Fusion, ser. Signal Processing & Digital Filtering. Springer Verlag, 1997. 

[3] C. Rago, P. Willett, and Y. Bar-Shalom, “Censoring sensors: a low-communication-rate scheme for distributed detection,” Aerospace and 
Electronic Systems, IEEE Transactions on, vol. 32, no. 2, pp. 554-568, 1996. 

[4] S. Appadwedula, V. Veeravalli, and D. Jones, “Decentralized detection with censoring sensors,” Signal Processing, IEEE Transactions on, 
vol. 56, no. 4, pp. 1362-1373, 2008. 

[5] -, “Energy-efficient detection in sensor networks,” Selected Areas in Communications, IEEE Journal on, vol. 23, no. 4, pp. 693-702, 

2005. 

[6] R. Jiang and B. Chen, “Fusion of censored decisions in wireless sensor networks,” Wireless Communications, IEEE Transactions on, vol. 4, 
no. 6, pp. 2668-2673, 2005. 

[7] P. Addesso, S. Mai'ano, and V. Matta, “Sequential sampling in sensor networks for detection with censoring nodes,” Signal Processing, 
IEEE Transactions on, vol. 55, no. 11, pp. 5497-5505, Nov 2007. 

[8] R. Jiang, Y. Lin, B. Chen, and B. Suter, “Distributed sensor censoring for detection in sensor networks under communication constraints,” 
in Signals, Systems and Computers, 2005. Conference Record of the Thirty-Ninth Asilomar Conference on, October 2005, pp. 946-950. 

[9] S. Marano, V. Matta, and P. Willett, “Distributed detection with censoring sensors under physical layer secrecy,” Signal Processing, IEEE 
Transactions on, vol. 57, no. 5, pp. 1976-1986, May 2009. 

[10] W. P. Tay, J. Tsitsiklis, and M. Win, “Asymptotic performance of a censoring sensor network,” Information Theory, IEEE Transactions 
on, vol. 53, no. 11, pp. 4191^209, Nov 2007. 

[11] C.-T. Yu and P. Vai'shney, “A paradigm for distributed detection under communication constraints,” in Information Theory, 1995. 
Proceedings., 1995 IEEE International Symposium on, Sep 1995, p. 293. 

[12] E. Msechu and G. Giannakis, “Sensor-centric data reduction for estimation with WSNs via censoring and quantization,” Signal Processing, 
IEEE Transactions on, vol. 60, no. 1, pp. 400-414, 2012. 

[13] Y. Zheng, R. Niu, and P. Varshney, “Sequential Bayesian estimation with censored data for multi-sensor systems,” Signal Processing, IEEE 
Transactions on, vol. 62, no. 10, pp. 2626-2641, May 2014. 

[14] H. Chen, B. Chen, and P. Varshney, “A new framework for distributed detection with conditionally dependent observations,” Signal 
Processing, IEEE Transactions on, vol. 60, no. 3, pp. 1409-1419, 2012. 

[15] V. Aalo and R. Viswanathan, “On distributed detection with correlated sensors: two examples,” Aerospace and Electronic Systems, IEEE 
Transactions on, vol. 25, no. 3, pp. 414-421, 1989. 


March 30, 2015 


DRAFT 


23 


[16] S. Iyengar, R. Niu, and R Varshney, “Fusing dependent decisions for hypothesis testing with heterogeneous sensors,” Signal Processing, 
IEEE Transactions on, vol. 60, no. 9, pp. 4888-4897, Sept 2012. 

[17] H. He, A. Subramanian, P. Varshney, and T. Damarla, “Fusing heterogeneous data for detection under non-stationary dependence,” in 
Information Eusion (EUSION), 2012 I5th International Conference on, July 2012, pp. 1792-1799. 

[18] H. He, A. Subramanian, X. Shen, and P. Varshney, “A coalitional game for distributed estimation in wireless sensor networks,” in Acoustics, 
Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. May 2013, pp. 4574-4578. 

[19] V. Kapnadak and E. Coyle, “Optimal density of sensors for distributed detection in single-hop wireless sensor networks,” in Information 
Fusion (FUSION), 2011 Proceedings of the 14th International Conference on, July 2011, pp. 1-8. 

[20] G. Whipps, E. Ertin, and R. Moses, “Distributed detection with collisions in a random, single-hop wireless sensor network,” in Acoustics, 
Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. May 2013, pp. 4603^607. 

[21] A. S. Abu-Romeh and D. L. Jones, “Decentralized detection in censoring sensor network under correlated observations,” EURASIP Journal 
on Advances in Signal Processing, 2010. 

[22] H. He and P. K. Vai'shney, “Distributed detection with censoring sensors under dependent observations,” in Acoustics, Speech and Signal 
Processing (ICASSP), 2014 IEEE International Conference on. May 2014, pp. 5055-5059. 

[23] S. G. Iyengar, P. K. Varshney, and T. Damarla, “A Parametric Copula Based Framework for Hypotheses Testing using Heterogeneous 
Data,” vol. 59, no. 5, pp. 2308 - 2319, May 2011. 

[24] B. Widrow and I. Kollar, Quantization Noise: Roundoff Error in Digital Computation, Signal Processing, Control, and Communications. 
Cambridge, UK: Cambridge University Press, 2008. 

[25] P. Willett, P. Swaszek, and R. Blum, “The good, bad and ugly: distributed detection of a known signal in dependent gaussian noise,” Signal 
Processing, IEEE Transactions on, vol. 48, no. 12, pp. 3266-3279, Dec 2000. 

[26] B. Schweizer and A. Sklar, Probabilistic Metric Spaces. New York: North Holland, 1983. 

[27] R. Nelsen, An Introduction to Copulas, 2nd ed. New York: Springer, 2006. 

[28] B. Widrow, I. Koll^, and M.-C. Liu, “Statistical theory of quantization,” Instrumentation and Measurement, IEEE Transactions on, vol. 45, 
no. 2, pp. 353-361, 1996. 

[29] B. Widrow, “A study of rough amplitude quantization by means of nyquist sampling theoiy,” Circuit Theory, IRE Transactions on, vol. 3, 
no. 4, pp. 266-276, 1956. 


March 30, 2015 


DRAFT 


